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INSTRUCTION, COMPARATIVE ANALYSIS, PRETENTION STUDIES, 
♦SOCIAL STUDIES UNITS, SECONDARY SCHOOL STUDENTS, 
♦INSTRUCTIONAL TECHNOLOGY , PALO ALTO 



THE EFFECTS OF USING A COMBINATION OF PROGRAMED 
INSTRUCTION AND CONVENTIONAL TEACHING PROCEDURES ON RETENTION 
OF SOCIAL SCIENCE MATERIAL WERE STUDIED. THE ORIGINAL 
LEARNING MATERIAL PERTAINED TO THE PRESIDENT AND THE NATIONAL 
ADMINISTRATION. MEASURES OF RETENTION WERE OBTAINED BY 
READMINISTERING AN 80-ITEM CRITERION TEST (APPENDED TO THE 
REPORT) 19 WEEKS AFTER THE INITIAL ADMINISTRATION. TOTAL OF 
150 SECONDARY STUDENTS PARTICIPATED IN THE ORIGINAL STUDY, 

AND OF THESE, 124 TOOK THE DELAYED RETENTION TEST. THE 
FOLLOWING RESULTS WERE OBTAINED-- (1) GROUPS WHICH USED 
PROGRAMING DID NOT DIFFER SI GNI FI CANTLY FROM GROUPS TAUGHT IN 
THE CONVENTIONAL MANNER AT EITHER THE COLLEGE-PREPARATORY OR 
GENERAL LEVEL, (2) EACH OF SIX GROUPS TESTED EXHIBITED A 
SIGNIFICANT DROP IN MEAN RETENTION SCORE, AND (3) VARIATIONS 
IN TEACHER PRESENTATION STYLE DID NOT AFFECT RETENTION. (JH) 
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lUTRODUCTION 



In a nuniber of studies descrilDed by Pressey and Robinson (19^^)/ 
investigators found that only a small percentage of material learned in 
the classroom was retained over a period of time. Very recently, por- 



formanee data from i'roject T’ aLk. jl- which involved nationwide testing of a 



sample o± 440,000 hi^ school students shovisd similar deficiencies in 
many subject matter areas. Such results have stimulated research in 
developing improved methods for effecting better initial learning and long- 
term retention. One promising method which has evolved in reci'int years is 
programed instruction. There is considerable evidence that students who 
use programs often perform better on immediate tests than students who are 
taught in a conventional manner. However, relatively little information 
is available on how the use of programed materials affects long-term 
retention. 

The research described here represents a preliminary study conducted 
as part of a project concerned with developing techniques for improving 
the permanency of learning through use of auto instructional programs for 
both initial learning and review. Data collected by Goldbeck, Shearer, 
Campeau, and Willis ( 1962 ) conveniently provided the means for studying 
the effects of using a combination of programed instruction and conventional 



teaching procedures on relatively long-term retention. The three primary 
phases of the Goldbeck study were (l) development of effective programed 
material for use in a one-month unit of a twelfth-grade course in U.S. 
Government, (2) exploration of various methods for introducing programed 
instruction in the classroom, and ( 3 ) tryout of the most promising of 
these methods in the actual classroom situation. Analysis of criterion 
test scores from the final phase of this research yielded the following 
findings: 

(1) classes in which programed instruction was used performed 
better than comparable non-programed classes, 

( 2 ) performance differences in favor of programed classes over 
non-programed classes were somewhat greater for general-level 
students than for college preparatory students. However, when 
achievement differences (grade -point average for two semesters 



of U. S. History) wre taken into account the between -ah ility 
level difference disappeared, a’M 

■i 

(3) there were no apparent differences in effect Ivenet > between I 

teachers using programed instruction for students grouped at 
either the college -preparatory or general levels. I 

The present study is concerned primarily with the following (questions: = 

(1) V?liat happens to perfonuance differences between programed and | 

non -programed classes over a period of time? 

'y 

(2) How much retention loss occ\irred during the 19 weeks between | 

the immediate and delayed tests? • 

(3) Even if there were no differences in the effectiveness with 

which they conducted initial instruction employing a composite j 

conventional and programed methods, do differences in 
retention appear later between classes tau^t by different j 

teachers? I 

I 

METHOD 

I 

i 

Material . The original learning material consisted of a linear, constructed- j 

response, autoinstructlonal program dealing with the President and the 5 

National Administration. The program consisted of four sections which 
together totalled 58 pages. This program segment was the second one of | 

three independent and self-contained segments used in the original study. 1 

At the end of a one -week period during which students had used this program | 

segment, an 80-item criterion test (see Appendix) had been administered to 
all students. To obtain measures of retention, the criterion test was i 

readministered to the participating students 19 weeks later. 

Subjects.. A total of I50 students, constituting six groups, had partici- I 

pated in the original study. Of these, 124 took the delayed -retention 5 

test, the other 26 having been lost throu^ roui;ine attrition. Table 1 
shows the arrangement of these students on the basis of the groiipB in the I 

original study. 
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HABLE 1 

Distributloc of Students According to 
Original I ..S. Government Classes 





'feaehe:[‘ A 


Teacher 


B 


Method 


College -Prep. General 


College -Prep. 


General 


Programed 


n = 23 n = 19 


n = 22 


n = 18 


Non -Programed 


1 

I 
1 
1 
f 
1 

CO 

OJ 

II 

c 




n = 19 



Percentile scores on the Differential Aptitude Test (Verbal) Mare used to 
test whether students in the cc0lj.ege -preparatory and general groups differed 
with respect to verbal ability. The difference in mean MT(V) scores 

college -preparatory and, general groups was found to be significant 
(P < .01), Differences among college -preparatory and general groups were 
not significant (P > .05). The groups also were compared with respect to 
achievement, l.e., performance in two semesters of U.S.- History as measured 
by grade -point average. Differences among the college -preparatory groups 
/ere not significant (p > .05), however, differences among the general groups 
were significant (P < . 01 ). Tbs difference between college -preparatory and 
general groups was significant [P < .001). The average within -group correla- 
tion between U.S. History grade “point average and delayed test score was .39. 

S ^ocedure . All the participatiui? students were retested simultaneously 
during a 30 -minute assembly period. The students were given a brief explan- 
ation of the purpose of the stuc.y and were encouraged to do their best. The 
tests were administered by Teacler B of the original study. The only 
advance warning the students received was an announcement given at the 
beginning of the first i>eriod tha.t they were to report to the school audi- 
torium. 

RESULTS 

l^ois^ramed Versus Non -Programed Groups . Analysis of covariance was used 
to evaluate differences between programed and non -programed groups with 
U.S* History grade -point average serving as a predictor variable. At 
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the college -preparatory level a comparison vas made "between delayed test 
scores of Teacher A*s group which used programs and the group which he 
instructed in the regular manner. The difference between the two groups 
was not significant (P > »05). A similar comiDarison was made at the 
general level between groups instructed by Teacher B. Ihe difference 
between the general grouns also was not n-igriitnVnnt (P .05). Tabic 2 
presents delayed test data for students according to the original class 
grouping. 



TABLE 2 

Belayed Test Means and Standard Deviations 



Method 




College -Pren. 


General 


College -Pren. 


General 


Programed 


Mean 


5 h .83 


45.t54 


53.86 


49.28 




S.Do 


7.73 


9.64 


8.96 


10.22 


Hon- 


Mean 


51.30 


mm mm m M» 


---- 


40.79 


Programed 


S.D. 


9.93 


— 




12.09 



Retention Decrements . Differences between immediate and delayed test 
means were analyzed for each of the six groups using an analysis of 
variance technique described by Wert, Neidt, and Ahmann (l95^) foi* ccan- 
paring correlated or matched groups. Differences between immediate and 
delayed test means were significant (P < .05) for all six groups. A 
separate analysis of retention decrements was performed to find cut how 
the various groups compared with respect to retention loss. Analysis of 
variance of retention decrements revealed no significant differences among 
the six groups (P > .05). Table 3 presents a summary of performance levels 
of the six groups. 
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TABIJ! 3 

Percentage of Initial Learning Retained 
After 19 Weeks (Corrected for Chance) 





Teacher A 


Teacher B 




Method 


C ollege -Prep . General 


College-Prep. 


General 


Programed 


8ojS 


79 ^ 


79 ^ 


Non -Programed 




--- 


GO 



Teacher Differences, Analysis of covariance ■was used to compare delayed 
test scores of programed groups at both the college -preparatory and general 
levels. Differences between mean scores which could be attributed to 
teachers were not significant (P> .05). 

DISCUSSION 

The main findings of this S'tudy are that (l) use of programs did 
not enhance delayed retention at either the college -preparatory or the 
general level, (2) there were marked retention decrements over the I9- 
week period, and (3; differences in teacher presen-bation styles did not 
have a differential effect on delayed retention levels. 

R;»ogramed Versus _Non -Programed Class Grouns . Data from this study shewed 
that the initial superiority in favor of programed classes at both levels 
1W.S not evidenced on retention measures. At both the college -preparatory 
and general levels, where significant differences had been found on ■the 
basis of immediate test scores, no significant treatment differences were 
ob-bained using delayed test scores. Alter (1962) found that level of 
intelligence had a significant effect on level of retention. Wittrock 
(1963) found a significant interaction be'bween mental age and response 
mode. Apparently, the ingelligence or aptitudfi of s'budents using programs 
does relate to initial performance but how it Influences retention is 
not clear at this time. 
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Retent ion Decrements * The rather sizeable tent ion decrements observed 



in the present study are consistent with results of a study by Alter 
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"viiiloh i-eueution measures were obtained at various time intervals 



up to 30 weeks follon^lng initial learning. She found significant delayed 
posttest decrements o^^er time. On the otdi&r hand, wittrock (07 clt.) 
studied program aTesponse modes using material which required '‘conceptual 
mediation” and reported a non -significant retention loss for both overt 
and coveid; groups over a one -year period. Ripple (1963) describes a study 
which investigated the effects of active involvement and reinforcement in 
programed -tiext material on learning and also investigated claims that 
programed learning improves retention and reduces individual differences. 

He concluded that active Involvement Increased learning but that retention 
was not improved. His findings are consistent with those of the present 
study as; well as the original. Goldbeck study (op. cit.) on which it Is 
based. 

Teacher Differences . The possibility that between -teacher differences 
ml^t manifest themselves on the delayed test was investigated primarily 
because, althou^ both teachers who participated in the study were highly 
competent, they nonetheless employed somewhat different styles of presen- 
tation. Teacher A*s technique can be summarized as consisting primarily 
of a series of descrlptiv^e lectures and explanations during which he cited 
numerous examples and applications drawn from his personal experience or 
with whi(sh he was familiar. Teacher B*s classes can be more appropriately 
described as lecture/dlscussions with r'=^latlvely more emphasis on basic 
fundamentals. It was hypotl.ieslzed that college -preparatory students could 
assimilate these basic fiindamentals from jncograms (or the and then 

derive further benefit from either descriptive lectures or discussions. 

On the other hand, general students might be expected to benefit more from 
a quasl-drlll situation with greater in-class emphasis on basic information. 
However, analysis of delayed test scores disclosed no significant between- 
teacher differences at either the college -preparatory or general level. 



SWARY 

This study investigated the effects of using a ccxablnation of 
programed instruction and conventional teaching procedures on retention 
of social science material. Measures of retention were obtained by 
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readministering an 80-item criterion test 19 “weeks after the initial 
adm5.nistration. The following results were obtained: groups which used 

programing did not differ significantly from groups which were tau^t in 
the conventional manner at either the college -preparatory or general level; 
each of six groups tested exhibited a significant drop in mean retention 
score; variations in teacher presentation style did^not effect retention 
differentially • 
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NAME 



PERIOD 



U,S. GOVERNMENT EXAMINATION: T13E PRESIDENT AND THE NATIONAL ADMNISTRATION 
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MULTIPLE CHOICE Please write the letter in 

front of the BEST answer 
in the blank at the left 
of each question. 



1. To win the election a candidate for the Presidency must have at 
least: 

A. a majority of the electoral votes 

B. two -thirds of the electoral votes 

C. a majority of the popular votes 

D. a plurality of the -ilectoral votes 



2. In most states the delegates to the national conventions that choose 
the presidential candidates are chosen by: 

A. the people 

B. the state party conventions 

C. the previous national convention 

D. the County Board of Supervisors 



3* A bill passes Congress and goes to the President for approval or 
veto. Suppose the President is generally in favor of the bill but 
thinks it takes in too much territory. Can he approve it in 
modified form? 

A. Yes, if he has already vetoed it once 

B. Yes, if Congress does not pass it again in 
its original form 

C. Yes, if it would cost no naore in the new form 

D. No 



k. According to the Hatch Act: 

A. no federal employee may participate in a political 
campaign 

B. no one may give over $5000 to any political 
committee 

C. ■'persons on relief are not allowed to vote 

D. time off from the job must be given for voting 

E. campaign workers cannot be paid 



_5* If the President appointed a new head for the Central Intelligence 
Agency, the appointment would have to be approved by: 

A. the House of Representatives 

B. the Senate 

C. both Houses of Congress 

D. the Electoral College 

E. the Central Intelligence Agency 
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^ Speaker of the Abuse is next in line after the Vice-President 
to succeed to the Presidency after the President's death. 

Pornerly the Secretary of State was next in line. The chacg.. 
was made because: 



A. it is essential for the person succeeding to the 
Presidency to be of the same party as the 
President in order to provide continuity 

B. there is always a Speaker of the House but there 
is not always a Secretary of State 

C. it was felt that the Secretary of State already 
had too much power 

D. the Secretary of State is named by appointment 
and therefore may not reflect the will of the 
people 



In the Electoral College each state of the Union has at least 
how many votes? 

A. One 
B« Two 

C. Three 

D. Four 



The State of Colorado sends eight representatives to the House 
^feprssentatives • How many votes does it have in the 
Electoral College? 

A. One 

B. Three 

C • Eight 

D. Ten 

E« Not enough information is given to answer this 
question 



The only President to serve more than two terms (full terms) was: 
A« Woodrow Wilson 
B. Franklin D. Roosevelt 
C • Harry Truman 

D. Theodore Roosevelt 



If the Cabinet agrees unanimously on a certain course of action, 
the President ; 

A* must follow it 

B, must follow it if he cannot convince at least 

1/3 of the Cabinet that his point of view is right 

C. can do as he likes regardless of what the Cabinet 
thinks 


















11 . The Bureau of Mines would he concerned with all of the following 
except ; 

A. raising oiiners' wages 

B. preventing waste of natural gas 

C. production of a rare gas 

D. deveiopoient of improved safety helmets 
for miners 

E. checking th^^ quality of coal used in 
the furnaces of Army barracks 

12 . If the Secretary of State is to be fired, who fires him? 

A. The Department of State 

B. The President 

C. The Senate 

D. The President and the Senate 

E. Both houses of Congress voting together 



13 • The independent offices, agencies, and commissions are called 
independent because they are independent of; 

A. the President 

B. Congress 

C. the major government departments 

D. public opinion 

E. state rule 



l 4 . The chief purpose of the Department of Agriculture is to; 

A. control agricultural surpluses 
B* increase the efficiency of agricultural 
production 

C. control harmful insects and plant diseases 

D. carry out an educational program 

E. set prices for food and fiber products 



15 • All of the following are independent agencies except the; 

A. Federal Civil Service Commission 

B. Interstate Commerce Commission 

C. Federal Communications Commission 

D. National Labor Relations Boeu^d 

E. Bureau of Mines 



16 • The Department of Labor is most concerned with; 

A. solving unemployment problems arising from 
automation 

B. keeping wages low enough for American 
manufacturers to compete with those of Europe 

C. protecting laborers* voting rights 

D. relaxing the immigration laws 

£. providing pensions for disabled veterans 
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jL7« If it were not ttiat the;/ already have too much work to do without 
it( the work of the vsLriCuiS inciepeiideut hoards Bind commissions of 
the Itoited Stateei goveriimein t would lae done by the: 

A. Senators 
B Represcjatatives 
G. Supfemfij Court Judges 
D. governors of th€i various states 

E« executive departments 



l8. The legal arm of our Fedei’al G(5vernaient is: 

A. the P.13.1, 

B. the Departmemt of Justice 

C. the Supreme Coui't 

D. the legislative brancsh of the government 



19« The Narcotics Buareau is one of the divisions of: 

A. the Department of Commercs 

B. the Dejpartmcjnt of Lalaor 

C. the De]}artment of He^alth^ Education^ and Welfare 

D. the Iteasury Department 



20, If you were Secrcstar;/ of State toda/^ which of the following 
would not be a responsibility of your department? 

A. Publish all the laws passisd by Congress 

B. Publish all the proclamations issued by 
the Preisident 

C. Admini£(ter the I’oreifpa Service 

D. Supervj.se the colileci^ion of tariffs on goods 



21. Social security j.s adminislsred by the Department of: 

A. the Interior 

B. Labor 

C. the Treasary 

D. Health), Educatici:D| and Welfare 

E. Commercs 



22. If the Uhited Sttites gov^ei'ninent*s State Department follows a 
foreign policy toward Latj.n America that is a failure, who 
ultimately is responsj.bleT 

A* The Cabinet 

B. The Secretai’y of State 

C. The President 

D. Congress 

E. The Fbirelgn Ser\rice 
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23. 



24 . 



25. 



26. 



27. 



28. 
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The Treasury Department c»f the Itaited States has the power to: \ 

A* lay teoces i 

B. collect taxes i 

C. Impose duties 

D. to borrow morjey on the credit of the United | 

Steites 



Which one of the followlEiij is not an executive Cabinet officer? 

A. Attorney-Generfi.1 

B. Secretary of tlie Interior 

C. Secretary of W«a' 

D« Postmaster General 



The 



heads of executive departments are also: 

A« Foreign Services officers 

B« Cabinet member) > 

C. civil-service lippointees 

D« legislators 

E. active peirty members 



The chairman of the Joint Chiefs of Staff is: i 

A* a civilian appointed by the President | 

B. a military officer 

C. head of the Department of the Army, Navy, J 

or Air Force 

D. a military mar appointed by the Secretary 5 

of Defense j 

Ss the Secretary of Defense ^ 



The President and Vice-]?:resident are guarded chiefly by the: 

A. FBI 

B. Civil Service 

C. Secret Service 

D. Coast Guard 

E. Marines 



The Department of Defense was established to: 

A. improve co-o])eration among the armed forces 

B. make it easier to negotiate with organizations 
such as NATO 

C. make it possible for all military affairs to 
be administe:ired from the Pentagon 

D. prevent too great a centralization of 
military powar 

E. give the President more power as commander- 
in-chief 
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29* If you were an employee of the Bureau of Mines, you would be 
under ; 

the Department of Agriculture 

B. the Department of Defense 
, C. the Department of Commerce 

D. the Department of the Interior 



30. Co-operation among the military services has been made especially 
necessary by the; 

A. need for missile and space research 

B. reduced authority of the Joint Chiefs 
of Staff 

C. tax burden involved in payments to veterans 

D. need for extending defense contracts to 
small business 

E. need for forces that could fight small 
"brushfire” wars 



31, The Post Office Depetrtment loses money every year, chiefly because; 

A. the building of new post-offices is carried on 
in times of depression as a form of work relief 

Be the Post Office has to pay part of the expenses 
of the railroads and highway system over which 
the mail is carried 

C. the Post Office also supports a banking system 

D. a ©peat deal of mail is carried at less than cost 

32. The President need not take the advice of his cabinet if; 

A. the vote does not reach a majority 

B. one cabinet member abstains from voting 

C. other competent advice contradicts it 

D. he disagrees with it 

E. Congress is opposed to it 



33, If you were in the Secret Service, you would be working for: 

A. the Department of Justice and the F*B.I. 

B. the Navy Department 

C. the Treasury Department 

D. the State Department 










Most of the money for expensive presidential campaigns comes 
from: 

Ai state tax funds 

B. congressional appropriations 

C« contributions of $1000 or less 

D, a very few wealthy individual contributors 



35* The powers of the President have been broade:aed over the years 
by the action of strong individual Presidents and by: 

A. the Constitution 

B. the State Legislatures 

C. agreement between the two major peurties 
D« Congress 



36 . Which one of the following states would lose most voting power 
by having a presidential election thrown into the House of 
Representatives ? 

A. Alabama 

B. Montana 

C • Vermont 

D. California 

E. West Virginia 



37* The Hoover Commission’s purpose was to: 

A. improve government efficiency 

B. strengthen international relations 

C. reorganize the Republican Par-Hy 

D» assist the under -developed nations 

S. insure civil rights 



38 . Immigration and naturalization affairs are taken care of by the 
Department of: 

A. Healthy Education and Welfare 

B. Labor 
C» State 
D» Defense 
E. Jbtetice 



39* How are delegates to the national nominating conventions chosen 
in most of the states? 

A. By presidential-preference primaries 

Bm By popular vote of all voters 

C. By state party conventions 

D» By caucus of party leaders in the 

state government 












ho, A certain presidential candidate, from out of the state, wins 
the presidential “Preference primary in a vsi* smiill state. 

Of what advantage is this to him? 

A. The state *s delegates are pledged to support 
him at the national convention 

B. He is sure of at least three votes in the 
Electoral College 

C. He becomes a "favorite -son” candidate 

D. The state party organization gusirantees 
him campaign expenses 

_4l. The government tries to limit campaign contributions by any one 
person, chiefly because; 

A. it wants all persons to participate in 
citizenship activities 

B. if one person gave a large sum he might 
expect favors in return 

C* presidential campaigns are already too 
long and too much of a drain on the 
energy of the candidate 

D. large contributions to one party would 

put the other at too much oj." a disadvantage 



42. Power over the United States foreign affairs is divided between 
the President and the; 

A. Congress 

B. Supreme Court 

C. Department of Defense 

D. state governments 

E. Uhited Nations 




Bureaus 

except: 

A. 

B. 

C. 

D. 

E. 



of the Department of Commerce do all of the following 

set up qualifications for pilots of 

private planes 

predict hurricanes 

promote overseas trade 

protect the rights of inventors 

protect factory workers 



44. How does Congress usually exercise control over members of the 
Cabinet? 

A. By impeaching them 

B. Through the President 

C. By its pov/er of limiting funds 

E. By the spoils system 




l8 






• A continuing problem of our national defense establishment 
A« lack of a seat on the Cabinet 

the Army, Navy, and Air Force carrying 
on separate but similar work 
C« concentration of all research in the Army 
D* military ownership of most of the means 
of defense production 



E« civilian control of atomic energy 
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• The head of the Department of Justice is known as the? 

A. Chief Justice 

B. Attorney General 

G. Secretary of Justice 

D. Adjutant 

E. Secretary General 



Classify the President's Powers 



In Column B on the right are the different kinds of 
powers exercised by the President. On the left in 
Column A are some specific powers. Place the letter 
of the correct type of power listed in Column B beside 
the number for each item in Column ^ “ 



A B 

He appoints cabinet members A. Executive power 

B. Legislative power 

He grants pardons C. Judicial power 

He delivers the State of the Itoion message 

He sends special messages to Congress 

He delivers the Budget message 

He vetoes bills 

He appoints Federal judges 

Ke is Commander-in-Chief of the armed forces 

He guarantees to every state a republican form of government 

He conducts foreign affairs 

He may pocket-veto a bill 

He grants reprieves 

He negotiates treaties 

He grants amnesties 

He may suspend the writ of habeas corpus in extreme national 
emergency 
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TRUE - FALSE 



Please write T or P in the blank 
at the left of each statement. If 
a statement is partially false con- 
sider it totally false. 



1. Only the President has the power to declare war. 



2. Congress can override a "pocket veto” by a two-thirds vote 
of both houses. 



3« The National Chairman of each party is generally selected by 
its presidential candidate <> 



Althou^ the President may negotiate treaties with foreign 
contries, all such treaties must be ratified by a two- 
thirds vote of the Senate, 



5* The President can restrict the power of the legislative branch 
through use of the veto but he has no control over the judicial 
branch. 



6, The President can accept part of a bill and veto part of it 
due to his "item veto" power. 



7, A presidential candidate can receive a majority of the popular 
votes in the nation and yet receive a minority of the electoral 
votes . 



8. The Cabinet shares with the President the responsibility for 
Congressional action in a time of national emergency. 



9, The Patent Office is part of the Department of the Interior, 
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10 . The FBI is a division of the Treasury Department. 



11 . Cabinet members have the right to appear before Congressional 
Committees and present their views but may not vote on bills. 



12 . The President may dismiss a cabinet officer without the approval 
of the Senate. 



13. The Pure Food and Drug Administration is under the Department of 
Commerce. 



l 4 . The Department of Commerce is to business what the Department of 
Labor is to workers. 



15. Independent buret us and commissions, as well as administrative 
assistants to the President, are under the jurisdiction of the 
Departments of the Cabinet. 



16- The U-S. Constitution makes no provision for the President’s 
Cabinet. 



17* The Treasury Department of the Ifaited States has the power to 
”lay and collect taxes, duties, imposts and excises.” 



16. The Vice-President now sits in with the President’s Cabinet 
and is a member of the National Security Council. 



19. Independent boards and commissions exe usually created by the 
President . 
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